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SYSTEM AND METHOD FOR USING DELAYED ENHANCEMENT MAGNETIC 
RESONANCE IMAGING AND ARTIFICIAL INTELLIGENCE TO IDENTIFY 
NON-VIABLE MYOCARDIAL TISSUE 

5 Cross Reference to Related Application 

This application claims the benefit of U.S. Provisional Application Serial 
No. 60/415,840, filed on October 3, 2002, which is incorporated by reference in 
its entirety. 

10 Field of the Invention 

The present invention is directed to a system and method for segmenting 
myocardial tissue using medical images (e.g., Delayed Enhancement MR, Cine 
MR), and more particularly, to a system and method for using support vector 
machines to intelligently identify non-viable myocardial tissue using one or more 
15 features that are characteristic of that tissue type. 

Background of the Invention 

In the aftermath of a heart attack, the identification and assessment of 
non-viable (necrotic) tissues is necessary for effective development of 

20 intervention strategies and treatment plans for certain types of heart disease. 

Those tissues which are healthy or capable of recovery through coronary bypass, 
stent placement, etc., should be distinguished from those which are non-viable, 
or irreversibly damaged. In this way, predictions may be made as to which 
patients might benefit from revascularization so as to increase their cardiac 

25 function and survival rate. 

Physicians rely on several non-invasive indicators for determining viability 
of myocardial tissue. The morphology of the myocardium, specifically its 
thinning, is evidence of necrotic tissue. In addition, abnormal motion, such as 
passive movement of a region or in extreme cases no movement at all can 

30 indicate myocardial damage. However, although morphology and functional 
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changes are indicative of tissue abnormality, they are not sufficiently sensitive to 
differentiate abnormal from non-viable (dead) tissue. 

Contrast enhanced imaging techniques may also be used to help identify 
non-viable regions. Positron-emission tomography (PET) and single-photon- 
5 emission tomography SPECT are capable of indicating viability information 
through differential signal intensity. However, these modalities are of limited 
utility as their resolution is quite low and are not generally available in the case of 
PET. 

Recently a new contrast enhanced imaging technique, Delayed 

10 Enhancement Magnetic Resonance (DEMR) has been shown to enable direct 
visualization of non-viable myocardium. DEMR imaging is a technique whereby 
non-viable myocardial tissue appears with increased signal intensity. DEMR is 
typically performed using a standard inversion recovery MRI acquisition 
sequence 20-30 minutes after administration of paramagnetic contrast agent 

15 (e.g., Gd-DTPA). Furthermore, DEMR has sufficient spatial resolution to 

accurately distinguish viable (normal or ischemic) from non-viable myocardium 
within the left ventricular wall. Radiologists typically acquire these images in 
conjunction with other functional modalities (e.g., MR Cine), and use domain 
knowledge and experience to isolate the non-viable tissues. 

20 Even with the information provided above, determination of tissue viability 

can be challenging. First, DEMR is prone to false negatives. That is, a region 
which is non-viable may not have increased signal intensity. Second, assigning 
viability status based on morphology and differential morphology (thickening or 
wall motion) requires a certain amount of experience and intuition. And, the 

25 indicators describing abnormal wall motion may be conflated. In other words, is a 
particular region of the heart moving independently or is it being pulled along by 
a neighboring region? In short, it may take an expert to label a region as non- 
viable. 

Despite the difficulty in its identification, there remains a great deal of 
30 interest in locating and quantifying non-viable tissues because it has been shown 
that the extent of infarction is closely related to long-term improvement in cardiac 
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function after coronary revascularization. However, DEMR is a recent technique 
not yet approved by the FDA and a clinician new to DEMR will not be as 
experienced as experts that have had a hand in testing and developing it. Ideally, 
the clinician, novice or not, would be provided with feedback from an expert. 
5 There has been a great deal of work on DEMR, but there have been few 

schemes described for automatically segmenting it. In one known technique, a 
region of viable myocardium in a DEMR image is manually isolated, its average 
intensity found, and pixels with intensities two standard deviations above are 
labeled as non-viable. Previous MRI techniques have either used cardiac 
10 morphology and function alone to determine tissue viability, or have examined 
the relationship between the amount of non-viable tissue and resulting cardiac 
function. 

As mentioned above, DEMR is prone to false negatives. And, traditional 
techniques for segmentation such as region growing or thresholding of DEMR 
15 yield inadequate results. 

Summary of the Invention 

The present invention is directed to employing a machine learning 
technique, such as Support Vector Machines (SVM), to arrive at a segmentation 

20 strategy by incorporating multiple indicators in order to identify non-viable 
myocardial tissue. The present invention segments non-viable myocardial 
regions automatically using DEMR, morphological and differential morphological 
information. Artificial intelligence techniques are used to "learn" how an expert 
would perform the segmentation. Thereby the clinician in the field is provided 

25 with a second opinion of the form, "Our expert would rate the following regions as 
non-viable with a such-and-such percent confidence." Ultimately it is the 
clinician's responsibility to categorize tissues as viable or non-viable. However, 
this type of feedback can be valuable input and assist the clinician in making an 
appropriate medical diagnosis. In the worst case, it speeds the clinical 

30 throughput by providing a good, editable guess at a solution. 



4 

Brief Description of the Drawings 

Preferred embodiments of the present invention will be described below in 
more detail, wherein like reference numerals indicate like elements, with 
reference to the accompanying drawings: 

5 FIG. 1 is a block diagram of a system architecture for an exemplary 

Magnetic Resonance Imaging (MRI) system in accordance with the present 
invention; 

FIG. 2 is an image created using DEMR of a left ventricle of a patient's 

heart; 

10 FIG. 3 is a flow chart illustrating a method for using support vector 

machines to segment myocardial tissue and determine which tissue, if any, is 
non-viable; 

FIG. 4 is a graph illustrating a plotting of a decision surface based on 
measurements taken relating to three myocardial features; and 
15 FIG. 5 is an illustration of an exemplary user interface that shows data 

from a DEMR screening. 

Detailed Description 

The present invention is directed to a system and method for using 
20 support vector machines to intelligently identify non-viable myocardial tissue 
using one or more features of myocardium that are characteristic of non-viable 
tissue. FIG. 1 is a block diagram of an exemplary Magnetic Resonance Imaging 
(MRI) system in accordance with the present invention. An example MRI system 
is a MAGNETOM class MRI system manufactured by Siemens AG. 
25 FIG. 1 illustrates a schematic representation of components of the MRI 

system located in a scan room 100. A magnet 108 produces a first magnetic 
field for the imaging procedure. Within the magnet 108 are the gradient coils 110 
for producing a gradient in the magnetic field in the X, Y, and Z directions. Within 
the gradient coils 1 10 is the Radio Frequency (RF) coil 112. The RF coil 1 12 
30 produces a second magnetic field necessary to rotate the spins by 90° or 180°. 
The RF coil 112 also detects the signal from the spins within the body. A patient 



102 is positioned within the magnet 108 by a computer controlled patient table 
106. The table 106 has a positioning accuracy of 1 mm. The scan room 100 is 
surrounded by an RF shield 104. The shield 104 prevents the high power RF 
pulses from radiating out through the hospital. It also prevents the various RF 
5 signals from television and radio stations from being detected by the MRI system. 
Some scan rooms are also surrounded by a magnetic shield which contains the 
magnetic field from extending too far into the hospital. In newer magnets, the 
magnet shield is an integral part of the magnet. 

A central element of the MRI system is the computer 126. The computer 

10 126 controls all components on the MRI system. The RF components under 
control of the computer 126 are the radio frequency source 1 38 and pulse 
programmer 134. The radio frequency source 138 produces a sine wave of the 
desired frequency. The pulse programmer 134 shapes the RF pulses into 
apodized sine pulses. An RF amplifier 136 increases the pulses power from milli 

15 Watts to kilo Watts. The computer 126 also controls the gradient pulse 
programmer 122 which sets the shape and amplitude of each of the three 
gradient fields. The gradient amplifier 120 increases the power of the gradient 
pulses to a level sufficient to drive the gradient coils 110. 

An array processor (not shown), included in some MRI systems, is a 

20 device which is capable of performing a two-dimensional Fourier transform in 
fractions of a second. The computer 126 off loads the Fourier transform to this 
faster device. An operator of the MRI system gives input to the computer 126 
through a control console 128. An imaging sequence is selected and customized 
from the console 128. The operator can see the images on a video display 

25 located on the console 128 or can make hard copies of the images on a film 
printer (not shown). 

Delayed Enhancement Magnetic Resonance (DEMR) has been shown to 
enable direct visualization of non-viable myocardium. DEMR imaging is a 
technique whereby non-viable cardiac tissue appears with increased signal 

30 intensity. DEMR is typically performed using a standard inversion recovery MRI 
acquisition sequence 20-30 minutes after administration of paramagnetic 



contrast agent (Gd-DTPA). Furthermore, DEMR has sufficient spatial resolution 
to accurately distinguish viable (normal or ischemic) from non-viable myocardium 
within the left ventricular wall. Radiologists typically acquire these images in 
conjunction with other functional modalities (e.g., MR Cine), and use domain 
5 knowledge and experience to isolate the non-viable tissues. 

It is to be understood by those skilled in the art that other contrast agents 
can be used in the DEMR procedure. For example, manganese or iron contrast 
agents can be used as well. Consideration of various contrast agents is 
described in an article entitled 'Tissue-specific MR Contrast Agents" by 

10 Weinmann HJ., Ebert W., Misselwitz B., and Schmitt-Willich H. in the European 
Journal of Radiology, Vol. 46, Issue 1 , pages 33-44, April 2003 which is 
incorporated by reference. 

FIG. 2 illustrates an image created using DEMR of a left ventricle 202. As 
can be seen, by administering the paramagnetic contrast agent, different areas of 

1 5 the walls of the left ventricle show up as different intensities. As can be seen, the 
darker wall tissue 206 indicates that the tissue is viable. The brighter wall tissue 
204 indicates a higher likelihood that the tissue is non-viable. 

The present invention is further enhanced by using artificial intelligence 
techniques to "learn" how an expert would perform the segmentation. In 

20 particular, the present invention uses Support Vector Machines (SVM) to help a 
clinician determine whether heart tissue is non-viable tissue. SVMs are a 
supervised artificial intelligence technique in which a computer is trained to 
recognize a phenomenon given a series of examples. The training is based on a 
set of user selected features. This learning is considered "supervised" because 

25 the examples are tagged by an expert as belonging or not belonging, in our case, 
to a particular class. 

Thus, rather than specify a list of instructions as to how to recognize 
something, as a traditional computer program might do, the computer "learns" 
through a series of examples. SVMs have been applied to medical imaging 

30 classification and detection tasks previously. They have been employed in 

distinguishing the differentiating characteristics of polyps and healthy tissue in CT 
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colonography as well as in the classification of brains in PET images. In addition, 
micro calcifications in mammograms have been detected using SVMs. To our 
knowledge, however, this is the first application of SVMs to cardiac 
segmentation. 

5 The present invention takes a SVM and applies it to a high dimension 

feature space in order to predict an expert's classification of cardiac tissue as 
viable or not based on features described in the introduction. Specifically, a 
binary decision function is used, 

10 

/:Xc9T->9t (1) 
that maps the inputs (the raw information) 

15 

x = (x l9 .. m9 x H ) (2) 

to the outputs (the categories), where f(x) > 0 indicates the positive category. A 
20 learning algorithm selects a decision function from a space of candidate decision 
functions. The decision function takes the form 

/<*) = L^MW^rtxn+fc (3) 

25 

where <z>(x)is a function of the inputs known as a feature, y,e{-l,l}is the 

classification provided by the expert, / is the number of examples, and a t and b 

are the weights to be learned. We use for the kernel function, k , a 
30 Gaussian radial basis function of the form: 



35 



fc(^(i)^(x , )) = ^ (x) ^ (x ' )|2/ 



(4) 
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It may be shown that kernels of this form (following Mercer's conditions) have 
corresponding optimization problems which are convex, lacking local minima. 
Thus, in contrast to other pattern recognition systems such as neural networks, 
SVMs are guaranteed to converge in a bounded number of steps. We employ 
5 the Matlab implementation of SVMs. 

The following is the logic used to divide the myocardium into multiple 
segments. The classification into viable and non-viable regions takes place on 
two layers of radial sectors (inner and outer) of the myocardium. The 
myocardium is described by the endocardial border endo(0) = (x endo (0\y endo (0)) 
10 and epicardial border, epi{0) = (x epi (0),y epi (0)). A centerline, 

centertine(0) = (^ fcr/l „ c (^),yc^w/„,(^)) lj es midway between the two. 

The myocardium is broken up into an even number of n sectors, 5 . There 

are ~ inner sectors, S inner , and - outer sectors S outer , 
2 2 

15 S =S intur + S ouler (5) 



The inner sectors S inner = ^s ianeri are bounded by — <^< ^ (f + 1) and 

,=o ft n 

——i 

2 

endo(0)<r(0)<centerline(0) while the outer sectors S outer =Yj s outer , are bounded 



/=() 



20 by — < 0 < + and centerline{0) < r(0) < epi{0) . 
n n 

The challenge of employing SVMs is in the selection of features. By 
features it is meant those measurements taken which will result in an appropriate 
medical diagnosis regarding viable or non-viable myocardial tissue. Some 
features which may be included are the image intensity, wall thickness, evidence 
25 of heart wall thickening, homogeneity of image regions, the degree to which the 
bright regions (scar) extend across the heart wall (transmurality) and the position 
of the scar. In addition, the rate of contrast uptake, motion information from 
modalities such as Tagged-MR, or intensity from nuclear studies might be used. 
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It is to be understood by those skilled in the art that the features mentioned are 
merely exemplary and that other features may be included without departing from 
the scope and spirit of the present invention. It is also to be understood that a 
weighting scheme may be employed to distinguish importance of one or more 
features with respect to other one or more features. 

Choosing correct features will allow the decision function to separate the 
examples; inadequate or redundant features will result in poor partitioning. The 
features, 0(5) , are defined on the sectors defined above. Thickness is expressed 



Jr(/+1) 



n 

T 5mner = j(centerline(0)-endo(0))d0 (6) 



as defined for an inner sector, s innen . The thickness of the outer sector is defined 
15 similarly. Note that since the centerline is equidistant between the myocardial 
borders for a given radial demarcation, a pair of inner and outer sectors will have 
equal thickness values. Thickening is defined as the change in thickness of a 
sector from end-diastole to end-systole. 

Mean Intensity of a sector, M s is defined by 



2X 



where I p denotes the intensity of a pixel p in sector s . Homogeneity, H s , is 
25 expressed 

pes 
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where a] (p) represents the variance of the 3x3 neighborhood around p . 
Transmurality, U M , of a sector is also included 

U,= )g(.0))dd (9) 

n 

where g(0) represents the longest continuous chord of highlighted pixels from 

endocardial border (in the case of an inner sector) to centerline in the direction of 
6. 

The present invention employs a Sequential Minimal Optimization (SMO) 
technique to determine the weights, ar ,Mrom Equation (3). SMO works by, at 
each iteration, limiting the optimization to a subset of just two weights. This 
approach has advantages in speed (since the optimization problem contains only 
two points it may be solved analytically) and memory usage (the kernel matrix 
need not be stored in memory). 

To determine <rin the kernel as well as C, a compromise between 
maximizing the margin and minimizing the number of training set errors, the 
"leave-one-out strategy" is employed. 

Referring to FIGs. 3-5, the present invention will now be described with 
respect to an exemplary screening and set of data obtained using SVM and a 
number of identified features. In accordance with the example and with 
reference to FIG. 3, DEMR images and Cine MR (Flash or TrueFisp) images are 
taken of 14 patients at three short axis slice positions (i.e. perpendicular to the 
long axis of the ventricle) (step 302). Using the Argus software package from 
Siemens, an expert delineated the myocardial borders on all images. The 
software segments the endocardial and epicardial borders of the left ventricle 
(step 304). The Argus software package provides fully automated segmentation 
of high-contrast TrueFisp cine images. The myocardium was divided into 36 
radial sectors and each sector further subdivided circumferentially resulting in a 
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total of 72 sectors (step 306). Each sector was characterized as viable or non- 
viable by the expert. 

A total of 38 DEMR images slices (3 slices per subject, four slices 
excluded due to being anomalous) were obtained with ground truth provided by 
5 the expert. The ground truth is the expert's medical diagnosis. Each experiment 
consisted of 38 sub-experiments where one slice acted as a "test" and all other 
slices as training set (leave-one-out strategy). The average accuracy rate of all 
38 test sets was used to determine the parameters a and C needed for the SVM 
algorithm. Based on the experiments, we set a = 0.1 and C = 10 and achieved 

10 an average accuracy of 87%. 

FIG. 4 illustrates a projection of a resulting six dimensional decision 
surface onto 3 dimensions 404 that was obtained from measurements 
determined from the 38 DEMR image slices. In accordance with the present 
invention, the features measured were wall thickness (x axis 406), thickening of 

15 the myocardial tissue (y axis 402) and DEMR intensity (z axis 408). The 

measured features are then used to create the decision surface. The decision 
surface 404 has a negative margin meaning that the sectors were not completely 
separable into viable and non-viable categories based on our features. Each x 
indicates a non-viable sector and each • indicates a viable sector. By measuring 

20 the identified myocardial features for a patient, the decision surface can be used 
to help determine if and where there is non-viable tissue. 

FIG. 5 illustrates an exemplary user interface for displaying the myocardial 
data. Once the patient has been imaged and the features measured (step 308), 
the collected patient data is applied to the decision surface (step 31 0). Based on 

25 the outcome, a prediction is made as to whether each sector contains viable or 
non-viable tissue (step 312). The resulting data is then displayed using the 
interface (step 314). 

Included on the display are data pertaining to the MRI scan. In the upper 
left hand corner of the display is a DEMR image 502 of the heart and in particular 
30 the patient's Left Ventricle (LV) 504. As can be seen, the walls of the artery 504 
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appear to not be homogeneous in intensity. In other words, some areas of the 
LV wall appear to be brighter than other sections of the wall. 

Graph 526 plots brightness from DEMR, thickness and thickening over the 
sectors; the dotted lines show the ground truth (below) and predictions using the 
5 SVM (above). In the Prediction image 518, in the lower right corner of the 
interface, white sectors 524 indicate non-viable tissue, gray sectors 522 are 
sectors of uncertain viability, and black sectors 520 represent viable tissue. As 
discussed previously, these predictions are made using SVMs. 

The ground truth images 506, 512, in the lower left corner indicate the 
10 doctor's medical diagnosis based on the DEMR. In the ground truth image 506, 
the high intensity areas 508, 510 indicate the non-viable tissue. In the ground 
truth sector image 512, the white sectors 514 indicate the non-viable tissue and 
the black sectors 516 indicate the viable tissue. 

Having described embodiments for a method for segmenting myocardial 
15 tissue and determining if the tissue is non-viable using artificial intelligence 

techniques, it is noted that modifications and variations can be made by persons 
skilled in the art in light of the above teachings. It is therefore to be understood 
that changes may be made in the particular embodiments of the invention 
disclosed which are within the scope and spirit of the invention as defined by the 
20 appended claims. Having thus described the invention with the details and 

particularity required by the patent laws, what is claimed and desired protected 
by Letters Patent is set forth in the appended claims. 



